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Abstract 

We consider guarding classes of simple polygons using 
mobile guards (polygon edges and diagonals) under the 
constraint that no two guards may see each other. In 
contrast to most other art gallery problems, existence 
is the primary question: does a specific type of polygon 
admit some guard set? Types include simple polygons 
and the subclasses of orthogonal, monotone, and star- 
shaped polygons. Additionally, guards may cither ex- 
clude or include the endpoints (so-called open and closed 
guards). We provide a nearly complete set of answers to 
existence questions of open and closed edge, diagonal, 
and mobile guards in simple, orthogonal, monotone, and 
starshaped polygons, with some surprising results. For 
instance, every monotone or starshaped polygon can be 
guarded using hidden open mobile (edge or diagonal) 
guards, but not necessarily with hidden open edge or 
hidden open diagonal guards. 

1 Definitions 

We define the boundary of a polygon P (denoted dP) 
as a simple polygonal chain consisting of a sequence 
of vertices specified in counterclockwise order, and the 
open set enclosed by dP to be the interior of P (denoted 
int(P)). An edge e — pq of the polygon is an interval 
of dP between consecutive vertices p, q, and a diagonal 
d = rs of P is a straight line segment between non- 
consecutive vertices r, s of dP such d — {r, s} G int(P), 
i.e. the portion of d excluding its endpoints lies in the 
interior of P. 

We consider guarding int(P) using a subset of the 
edges and diagonals of P. A guard g sees or guards a 
location I in the polygon if / is weakly visible pQ from the 
guard: there exists a point p € g such that the interior 
of the segment Ip lies in the interior of the polygon. 
Edges and diagonals selected as guards are called edge 
guards and diagonal guards, respectively, and a mobile 
guard [9] is either an edge or a diagonal guard. If a set 
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S of edges and diagonals of P is such that every location 
in the interior of P is seen by at least one guard in S, 
then S is a guard set of P and P is said to admit a 
guard set. A closed guard set includes the vertices at 
both ends of each edge or diagonal. If all endpoints are 
excluded, the guard set is called an open guard set. 

In addition to simple polygons or simply polygons, we 
consider a number of special classes of polygons. An or- 
thogonal polygon is a polygon that can be rotated such 
that all edges are parallel to the x- or y-axis. A mono- 
tone polygon is a polygon that can be rotated such that 
the portion of the polygon intersecting any vertical line 
consists of a connected interval. A starshaped polygon 
is a polygon that can be translated such that an interior 
point coincides with the origin and sees all locations in 
the interior of the polygon, and the kernel of the poly- 
gon is the set of all points in the polygon with this prop- 
erty. These three classes (along with convex and spiral 
polygons) are described by O'Rourke [10j in the context 
of guarding problems as being "usefully distinguished in 
the literature." 

Finally, we add the constraint that a guard set is hid- 
den: no pair of guards in the set see each other. Here a 
pair of guards gi , gi in a polygon P can see each other 
if there exists a pair of points p € gi , q G g% such that 
pq - {p, q} G int(P). 

2 Introduction 

Edge, diagonal, and mobile guards in polygons have 
been studied extensively in the past. Avis and Tous- 
saint [1] considered the case where a single closed edge 
is sufficient to guard the entire polygon. Shortly after, 
Toussaint gave an example of a polygon whose smallest 
closed edge guard set is |_ n /4j [S] and conjectured that 
an edge guard set of this size is sufficient for any poly- 
gon. O'Rourke 9j showed that closed mobile guard sets 
of size are sometimes necessary and always suf- 

ficient for polygons. For closed diagonal guards, Sher- 
mer [T2] has shown that guard sets of size |_(2n + 2) /7J 
are necessary for some polygons, and no polygon re- 
quires a guard set of size greater than — l)/3j . 

More recently, open edge guards were suggested by 
Viglietta [T3] and studied by Benbernou et al. [2] and 
Toth et al. [T3], who showed that open edge guard sets 
of size [n/3\ and [n/2\ are sometimes necessary and 
always sufficient for simple polygons. 
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The study of hidden guards began with Shermer [TT] 
who gave several results, including examples of poly- 
gons that are not guardable using hidden vertex guards. 
The study of hidden edges has only been initiated re- 
cently by Kranakis et al. [5] who showed that computing 
the largest hidden open edge set in a polygon (ignoring 
guarding) cannot be approximated within an arbitrar- 
ily small constant factor unless P = NP. In the same 
theme, Kosowoski et al. [7] have studied cooperative 
mobile guards, where each guard is required to be seen 
by another guard. Such a constraint is the opposite of 
hiddenness, which forbids any guard from seeing any 
other guard. 

Here we evaluate the existence of hidden edge, diag- 
onal, and mobile guard sets for simple polygon classes. 
A summary of results is seen in Table [T] 



Guard class 


Polygon class 


Inclusion 


Type 


Simple 


Ortho 


Mono 


Star 


Open 


Edge 


No 


Yes 


No 


No 


Diagonal 


No 


No 


No 


No 


Mobile 


No 


Yes 


Yes 


Yes 


Closed 


Edge 


No 


No 


No 


No 


Diagonal 


No 


No 


No 


No 


Mobile 


No 


No 


No 


? 



Table 1: New results in this paper. Entries indicate 
whether a hidden guard set exists for every polygon in 
the class. 



3 Open edge guards 

Recall open edge guards are edges of the polygon ex- 
cluding the endpoints. 

Lemma 1 There exists a monotone polygon that does 
not admit a hidden open edge guard set. 




Figure 1: A monotone polygon that does not admit a 
hidden open edge guard set. 



Proof. See Figure [T] We refer to the convex regions 
bounded by three edges in the upper left and right por- 
tions of the polygon as ears. Consider guarding the 
pair of ear regions without using any of the three edges 
that form each ear. The cases resulting from these at- 
tempts are seen in Figure [2j In each case, any maximal 
combination of non-ear edges fails to guard either ear 
completely. Moreover, a portion of the remaining un- 
guarded region in each ear is not visible from any edge 
of the other ear. Thus any guard set contains one of the 
three edges in each ear. Also, every pair of ear edges in 
the same ear see each other, so any guard set contains 
exactly one edge in each ear. 




Figure 2: All maximal combinations of open edge guards 
that exclude the six ear edges. 

Next, consider possible ear-edge pairs containing one 
edge from each ear. In Figure [3] it is shown that for 
each such ear-edge pair, the pair cannot be augmented 
to form a hidden open edge guard set for the polygon. 
Thus the polygon cannot be guarded with hidden open 
edge guards. 




Figure 3: All combinations of ear edge pairs and the 
maximal hidden sets containing each ear edge pair. 

□ 

Lemma 2 There exists a starshaped polygon that does 
not admit a hidden open edge guard set. 

Proof. See Figure |4j The polygon consists of a central 
convex region with numerous spikes emanating from it. 
Figure [6] provides a labeled version of the polygon, with 
two sets of four large spikes each ({a^} and {h}) and 
four sets of two small spikes each ({01,02} forms one 
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Figure 4: A starshaped polygon that does not admit a 
hidden open edge guard set. 



such set). Call edges on the central convex region cen- 
tral edges and the spike pairs {a i, 03}, {02,04}, {&i,&3}, 
{62, 64} opposing spike pairs. Consider guarding the four 
spikes {ai} without using central edges (see Figure [5J. 
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Figure 5: The two possible guardings of the four spike 
{ai} without using central edges (dotted). 

Only one edge per opposing spike pair may be in any 
hidden edge guard set, as all four edges of an opposing 
spike pair see each other. Each spike has two asymmet- 
ric edges; one is able to guard the entire opposing spike 
pair, while the other is not. Each spike also contains a 
location not seem by any spike edge not in the spike's 
opposing spike pair. Finally, a pair of edges from a\ 
and 04 see each other, as do a pair in 02 and 03. So 
any hidden edge guard set for the opposing spike pairs 
{01, 03} and {02, 04} that does not include central edges 
consists of one of two pairs seen in Figure [5] 

Now consider guarding the entire polygon. Any cen- 



tral edge guards the interior of at most one spike from 
{ai} or {bi}. So one of the two spike sets {a^} and {bi} 
must be guarded without using central edges. Without 
loss of generality, assume the {cij} set is guarded in this 
way. Then one of the pairs of edges seen in Figure [5] 
must be in the guard set. Again without loss of gen- 
erality, assume the edge pair of ai and 02 are selected, 
as in Figure [6] Then there exist two spikes c\ and C2 
whose edges are both seen by the guard edges in spikes 
a% and a 2 , but portions of the interiors of C\ and C2 
remain unguarded. The only edges sufficient to guard 
the interiors of c\ and C2 are the central edges e\ and 
e 2 . However, e\ and e 2 each guard the interior of only 
one spike. Thus a portion of the interior of either c\ or 
C2 must remain unguarded, and the polygon cannot be 
guarded using hidden open edge guards. 




Figure 6: A incomplete but necessary set of guard edges 
and the region they guard. The interiors of c\ and c 2 
remain partially unguarded and cannot be guarded with 
a hidden open edge set. 



□ 



Lemma 3 Every orthogonal polygon admits a hidden 
open edge guard set. 

Proof. For an input orthogonal polygon P, select a 
guard set G in the following way: choose all edges of 
P parallel to the x-axis that bound the interior of the 
polygon from below. Given a location I € int(P), shoot 
a ray from I at angle —ir/2. If the ray does not intersect 
a vertex of dP, then it intersects an edge in G. If the 
ray does intersect a vertex (call it v), shoot two rays at 
angles — 7r/2 — e, tt/2 + e, with e > small enough that 
one of the edges intersected is incident to v. Such a e 
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exists because dP is simple. In either case, the segment 
from I to dP formed by the ray implies that the edge 
intersected can see I, so G is a guard set. 

Now consider any pair of guards g\, g 2 € G. If the y- 
coordinates of g\ and g 2 are distinct, then any segment 
from <7i to g 2 must leave the polygon entirely. If the y- 
coordinates are identical, the interior of a segment from 
<7l to g 2 must intersect a vertex of the edge containing 
gi and so 171 cannot see 512- So G is also a hidden set. □ 

For an input polygon with n edges, scanning the edges 
and selecting those with the properties described can be 
done by a simple 0(n) algorithm. 

4 Open diagonal guards 

Lemma 4 There exists a monotone and starshaped 
polygon that does not admit a hidden open diagonal 
guard set. 




Figure 7: A monotone and starshaped polygon that does 
not admit a hidden open diagonal guard set. 

Proof. See Figure [7] for an example. No single diago- 
nal is a guard set for the polygon, as it cannot see both 
regions near the uppermost pair of vertices. Every di- 
agonal has an endpoint in common with the lowermost 
horizontal edge of the polygon, and every diagonal has 
its other endpoint at a vertex above this edge. As a 
result, any pair of diagonals see each other via a hori- 
zontal line just above the lowermost horizontal edge of 
the polygon. So no set of multiple diagonals can form a 
hidden set. □ 

Lemma 5 There exists an orthogonal polygon that does 
not admit a hidden open diagonal guard set. 

Proof. See Figure [8j Any guard set must see the loca- 
tion in the center of the central convex region (location 
I in Figure [9]) . This point is only visible from a diagonal 
that has at least one endpoint on the central convex re- 
gion. The four possible diagonals with such an endpoint 
(up to symmetry) that guard I are shown in Figure [9] 

In the first case, the diagonal sees the region neighbor- 
ing P2 and all diagonals that see the region neighboring 
P3, but fails to guard the entire region around p%. In 
the next three cases, p\ sees all diagonals that could be 
used to guard the region neighboring p 2 , but does not 
see the region around p 2 entirely. □ 



Figure 8: An orthogonal polygon that does not admit a 
hidden open diagonal guard set. 




Figure 9: The possibilities for selecting a open diagonal 
guard that sees /, and the resulting unguardable regions 
("X" locations in the ears of the polygon). 

5 Open mobile guards 

Lemma 6 There exists a simple polygon that does not 
admit a hidden open mobile guard set. 

Proof. See Figure [TO] The polygon consists of a narrow 
tunnel connecting left and right clover-shaped gadgets 
that are identical and each have n/2 rotational symme- 
try. Consider guarding the the narrow tunnel connect- 
ing the left and right clover-shaped regions (which we 
call gadgets). Guarding the tunnel must occur via ei- 
ther an edge or diagonal in the tunnel or a guard in the 
left or right gadget. This results in either the left or 
right gadget falling into one of the three cases seen in 
Figure [TTJ 
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The first two cases of placing tunnel guards are an- 







Figure 10: A simple polygon that does not admit a 
hidden open mobile guard set. 



Figure 11: The three cases resulting from guarding the 
tunnel. 



Because the guard in the left or right gadget can only 
see locations in the other gadget through the tunnel, 
the placement of the guard seeing through the tunnel 
cuts off further illumination of one gadget from guards 
in the other. This yields a subproblem of guarding the 
remainder of either the left or right gadget using only 
guards in the gadget. 




\r 



Figure 12: Analysis of the first two cases of Figure 11 
In both cases, two minimal hidden guard sets see a pair 
of "X" locations in the lower left ear, yielding two sub- 
cases. One subcase results in an unguardable region in 
the lower right ear. The other subcase results in an 
unguardable region in the center of the polygon after 
selecting an edge guard in the upper left ear needed to 
see an "X" location in the ear. 



alyzed in Figure 12 The third case is analyzed in two 
phases: first, the subcases involving the use of a diago- 
nal guard or an edge guard incident to the central con- 
vex region of the gadget are enumerated and each case 
is shown to yield a set of two or three points that can- 
not be guarded using any hidden guard set containing 
the selected guard (Figure 13). Second, the subcases 



of guarding the gadget using only guards not consid- 
ered in the first phase (edge guards in the ears of the 
gadget) are enumerated. In some of these cases, a se- 
quence of necessary guards are selected in the situation 
that a location is seen by only one guard hidden from 
previously-selected guards. 




Figure 13: The first phase of subcase analysis of the 
third case of Figure [TT] Each case enumerates a possi- 
ble diagonal of the polygon, or an edge incident to the 
center convex region. The "X" locations in each sce- 
nario form a set of points that cannot all be guarded 
using a hidden guard set containing the existing guard. 
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Figure 14: The second phase of subcase analysis of the 



third case of Figure 11 Each case enumerates a possible 
selection of an ear edge and resulting sequence of nec- 
essary edge guards selected. In the two left cases, the 
three "X" locations form a set that cannot be guarded 
using any hidden guard set containing the initial guard. 
In the remaining cases, necessary guards are selected 
(numbered in order of selection) until a maximal guard 
set is formed with regions remaining unguarded. 



□ 



Observation 1 Let g be a geodesic path between a pair 
of vertices p,q in a polygon P. Then the interiors of the 
edges g form a set of hidden open mobile guards in P. 

We refer to such a guard set for a path g as the open 
mobile guard set induced by g. 

Lemma 7 Every monotone polygon admits a hidden 
open mobile guard set. 

Proof. Assume without loss of generality that the in- 
put polygon P is x-monotone, i.e. the intersection of 
every vertical line with the polygon consists of a single 
line segment s. Consider a geodesic g path between a 
pair of left- and rightmost vertices in P. Since g is a 
path between extreme vertices in the x-direction, s con- 
tains a point p <E g. As p sees all of s, g guards the 
entirety of P. 

Let G be the hidden open mobile guard set induced 
by g. The vertical segment s intersects either a point on 
a guard in G, or a vertex in V . If s intersects a vertex 
»6 7, then since the boundary of P is simple (i.e. non- 
intersecting) there must be a nearly-vertical segment 
for each location / € s connecting I to a location in the 
interior of an edge of g without intersecting dP. So G 
forms a guard set for P. □ 

For a polygon with n edges, computing such a guard 
set can be done in 0{n) time: finding left- and rightmost 
points in P takes 0{n) time, and finding the shortest 



path between them also takes 0(n) by combining the 
results of Garey et al. [3] and Guibas et al. [5]. 

A natural approach to finding an open mobile guard 
set for a starshaped polygon is to look for a mobile guard 
that intersects the kernel of the polygon. Unfortunately 
such a guard may not exist as noted in [TU] (see Fig- 
ure 



151. 





Figure 15: A starshaped polygon with no edge or diag- 
onal intersecting its kernel (gray). 

The following lemma is used in the proof of Lemma [9j 

Lemma 8 Let P be a starshaped polygon translated so 
that the origin lies in the kernel of P , and let v, v' be 
consecutive reflex vertices such that angle between the 
rays from v and v' through the origin ( sweeping from v 
to v' ) is at most 7r. If a geodesic path g € P intersects 
both rays either before or after they intersect the origin, 
then g guards the subpolygon R bounded by the portions 
of the two rays before they intersect the origin, and the 
portion of dP from v to v' . 

Proof. See Figure [16} Because k sees every point in P, 
the rays form angles of at most 7r with both edges inci- 
dent to v and v' on dP, and do not intersect dP before 
reaching the origin. Define the points on dP intersected 
by the rays from v and v' as i and i' , respectively. Let 
I be a location in the subpolygon R. 




Figure 16: A schematic for the proof of Lemma [H] 

Recall that the portion of dP between v and v' has 
only convex vertices, and the angle formed by the two 
rays at the origin is at most ir by assumption, so R is 
convex. If g intersects the rays before they intersect the 
origin, then the interior of an edge in g must intersect 
R and I is seen. Now suppose that g intersects the rays 
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after they leave the origin. Because g € P and the 
boundary of the polygon is simple, there exists some 
e > such that any ray from I through an £-disk around 
the origin intersects g before (or possibly as) the ray 
intersects dP. So a point on a guard in the hidden open 
mobile guard set induced by g sees I and thus this set 
is a guard set for R. □ 

Lemma 9 Every starshaped polygon admits a hidden 
open mobile guard set. 

Proof. Let P be a given starshaped polygon translated 
so that the origin lies in the kernel of P. Consider shoot- 
ing rays from each reflex vertex through the origin as 
seen in the left portion of Figure [TTJ Find a double 
wedge W formed by a consecutive pair of these rays 
such that each wedge is coincident to exactly one reflex 
vertex (which we call u and u') as seen in right portion 
of Figure |l7| as a dark gray region. Such a double wedge 
is formed by every pair of consecutive intersections of 
rays along dP such that one intersection is the start 
of a ray (at a reflex vertex of P), and the other is the 
termination of a ray. 



are actually a single non-convex subpolygon with reflex 



vertex at the origin (see Figure 18 ) 




Figure 17: Left: a starshaped polygon with rays from 
each reflex vertex through the origin. Right: the poly- 
gon and a double wedge W (dark gray) with one reflex 
vertex (it or u') incident to each wedge. The light and 
dark gray regions together form the subpolygons possi- 
bly left unguarded by the hidden open mobile guard set 
induced by a geodesic path from u to v! . 

For every consecutive pair of reflex vertices v,v' on 
dP, the rays from v and v' through the origin lie entirely 
in P — W. Two pairs are an exception: the two pairs 
containing u and u' that form a pair of wedges, each 
containing half of the double wedge W (seen as the dark 
gray double wedge extended with two light gray wedges 
in the right portion of Figure 17 1. For all remaining 



pairs, the geodesic path from u to u' intersects both 
rays either before or after they have passed through the 
origin. Therefore, by Lemma |5J the hidden open mobile 
guard set induced by g sees the entire polygon except 
(possibly) the pair of wedges bounded by two pairs of 
consecutive reflex vertices adjacent to u and v! . 

It may be the case that the two remaining wedges 




Figure 18: A polygon and double wedge W (dark gray 
region) where the region not necessarily guarded by the 
hidden open mobile guard set induced by the geodesic 
path from u to v! is actually a single non-convex polygon 
(light and dark gray regions combined) bounded by u 
and v! . 

In this situation the subpolygon can be bisected into 
two convex subpolygons by a ray bisecting the reflex 
angle at the origin. 




Figure 19: The two cases of guarding the remaining 
subpolygons. In the case shown in the upper part of 
the figure, the existing geodesic is sufficient to guard 
the wedge. In the second case, the geodesic leaves a 
portion of the wedge unguarded and must be extended. 

Recall that each convex subpolygon has a vertex u or 
u' in common with the geodesic's final edge (see Fig- 
ure 19). If the interior angle formed by these two edges 



is at most 7r, then the subpolygon is seen by the interior 
of the final edge of the geodesic. If not, the geodesic can 
be extended to include an edge of dP in the subpolygon 
that guards the subpolygon completely. 

Thus the hidden mobile guard set induced by the 
geodesic described guards P. □ 

Computing such a guard set for a polygon with n 
edges can be done in 0(n) time, as each step takes at 
most 0(n) time: 1. compute a point in the kernel of the 
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Lemma 11 There exists a starshaped polygon polygon 
that does not admit a hidden closed diagonal guard set. 

Proof. The polygon in Figure [7] does not admit hidden 
open diagonal guard set, and also fails to admit a hidden 
closed diagonal guard set for the same reason: no single 
diagonal is sufficient to guard the entire polygon and any 
set of two or more diagonals is not a hidden set. □ 



Figure 20: A polygon with a geodesic path inducing a 
hidden open mobile guard set for the polygon. The ini- 
tial geodesic from u to v! leaves the gray region incident 
to u partially unguarded, so the geodesic is extended by 
one edge. 

polygon (0(n) time by Lee and Preparata [S]). 2. find a 
separating angle 9 (0(n) time). 3. triangulate the poly- 
gon and find a geodesic between the reflex vertices u and 
u' (0(n) time by Fournier and Montuno [3| and Guibas 
et al. |5j). 4. check whether the two remaining subpoly- 
gons are already covered by the geodesic, and extend the 
geodesic by an additional edge if necessary (0(1) time). 



7 Closed mobile guards 

Lemma 12 There exists an orthgonal polygon that does 
not admit a hidden closed mobile guard set. 



6 Closed edge and diagonal guards 

In the next section we present orthogonal and monotone 
polygons that do not admit hidden closed mobile guard 
sets. Note that these polygons also serve as examples 
of polygons that do not admit hidden closed edge or 
hidden closed diagonal guards. For starshaped polygons 
no such example is known. 

Lemma 10 There exists a starshaped polygon that does 
not admit a hidden closed edge guard set. 




Figure 21: A starshaped polygon that does not admit a 
hidden closed edge guard set. 



Proof. See Figure [21] Every edge has at least one end- 
point on the central convex region, so any hidden edge 
set has at most one edge. However, no single edge is 
sufficient to guard the polygon as no edge guards the 
interior of both spikes completely. □ 



Figure 22: An orthogonal polygon that cannot be 
guarded using hidden closed mobile guards. 



Proof. See Figure 22 We refer to the convex regions 
in the lower left and upper right of the polygon as ears, 
and the narrow region in the lower right of the polygon 
as the cave. First, consider guarding the cave region. 
Any guard that sees a portion consisting of more than 
four convex vertices in the cave sees a narrow strip of 
space extending to the end of the cave and containing 
all reflex vertices in the cave. As a result, a second 
guard inside the cave is not permitted, as either: 1. an 
endpoint of the second guard is seen by the first guard, 
or 2. the second guard intersects the narrow strip seen 
by the first guard. Therefore, a single guard extending 
the length of the cave is needed, and because no vertex 
in the remainder of the polygon can be connected to 
such a guard, this guard ends at a vertex at the mouth 
of the cave. 

Now consider guarding the remainder of the polygon 



(see Figure 23). The guard inside the cave is unable 
to see either ear. Guarding both ears using a second 
guard is forbidden, as such a guard must intersect the 
region seen by the guard in the cave. Guarding one ear 
using a second guard results in an unguarded region in 
the other ear, and no hidden guard choices remaining. 
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Figure 23: Attempting to guard an orthogonal polygon 
with closed mobile guards. An initial guard spanning 
the length of the cave is necessary, and a second guard 
for an ear results in an unguardable region in the other 
ear. 

So the polygon does not admit a hidden closed mobile 
guard set. □ 

Lemma 13 There exists a monotone polygon that does 
not admit a hidden closed mobile guard set. 




Figure 24: A monotone polygon that cannot be guarded 
using hidden closed mobile guards. 

Proof. See Figure [24] The construction is similar to 



that of Figure 22 with a long cave (right portion of the 
polygon) and pair of ears (lower and upper left portion 
of the polygon). Guarding the cave requires using a 
single diagonal guard that extends the length of the cave 
(see Figure 25). As a result, two guards are needed to 



guard the triangular pair of ears in the left portion of 
the polygon. Any two such guards must see each other, 
so the polygon does not admit a hidden closed mobile 
guard set. 

□ 

We end with the open problem from Table [I] 

Conjecture 1 Every starshaped polygon admits a hid- 
den closed mobile guard set. 




Figure 25: Attempting to guard a monotone polygon 
with hidden closed mobile guards. An initial guard 
spanning the length of the cave is necessary, and a sec- 
ond guard for an ear results in an unguardable region 
in the other ear. 
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